QUALITATIVE ANALYSIS

Goal-Oriented End-to-End Conversational Models with Profile Features in a Real-World Setting (N19-2)

Challenge:	Automatic Speech Recognition (ASR) post-processing requires substantial amounts of data, requiring expensive phonetic transcription experts.
Approach:	They propose a "Hyper-BTS" dataset that is five times larger than prior studies . they propose criteria for categorizing error types within ASR post-processing .
Outcome:	The proposed method can generate ASR inputs from clean text using a text-to-speech system.

Copied to clipboard

Yichao Lu, Manisha Srivastava, Jared Kramer, Heba Elfardy, Andrea Kahn, Song Wang, Vikas Bhardwaj

COVID-19 and Misinformation: A Large-Scale Lexical Analysis on Twitter (2021.acl-srw)

Challenge:	a recent study has focused on how algorithmic improvements help model performance on fabricated datasets.
Approach:	They propose two approaches to train conversational neural models for goal-oriented conversational systems . they train models on historical chat transcripts and test on live contacts .
Outcome:	The proposed model is able to generate top-four responses on live contacts . the model is also able for customer profile features to assess their impact on performance .

Copied to clipboard

Dimosthenis Antypas, Jose Camacho-Collados, Alun Preece, David Rogers

Reasoning

Challenge:	Social media is used by individuals and organisations as a platform to spread misinformation.
Approach:	They compile a large corpus of tweets related to coronavirus and perform an analysis to discover patterns with respect to vocabulary usage.
Outcome:	The proposed model based on lexical features is effective in identifying misinformation-related tweets with accuracy over 80%.

HARE: a Flexible Highlighting Annotator for Ranking and Exploration (D19-3)

Copied to clipboard

Denis Newman-Griffis, Eric Fosler-Lussier

Challenge:	Using NLP techniques to analyze new information domains is challenging, authors report . authors demonstrate use of HARE to rank documents based on their relevance to mobility .
Approach:	They propose a system for highlighting relevant information in document collections to support ranking and triage.
Outcome:	The proposed system can be used to rank and explore documents in clinical data . it provides tools for post-processing and qualitative analysis for model development and tuning.

Entity Contrastive Learning in a Large-Scale Virtual Assistant System (2023.acl-industry)

Copied to clipboard

Jonathan Rubin, Jason Crowley, George Leung, Morteza Ziyadi, Maria Minakova

Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision (2024.naacl-long)

Challenge:	Named Entity Recognition (NER) tasks are a well-studied and fundamental task within Natural Language Understanding (NLU).
Approach:	They propose to incorporate entity contrastive learning into a virtual assistant system to improve NER models by clustering similar inputs closer together in a learned representation space.
Outcome:	The proposed model improves against a production baseline system that does not use contrastive learning.

Copied to clipboard

Seongyun Lee, Sue Park, Yongrae Jo, Minjoon Seo

Q-learning with Language Model for Edit-based Unsupervised Summarization (2020.emnlp-main)

Challenge:	Recent studies have conjectured that multimodal hallucination is due to the vision encoder failing to ground on the image properly.
Approach:	They propose a multimodal self-feedback guided revision model that leverages visual cues to generate feedback to its initial response based on the visual information provided by the vision encoder.
Outcome:	The proposed model reduces multimodal hallucination and outperforms previous models on MMHal-Bench, POPE, and GAVIE.

Copied to clipboard

Ryosuke Kohita, Akifumi Wachi, Yang Zhao, Ryuki Tachibana

PANCETTA: Phoneme Aware Neural Completion to Elicit Tongue Twisters Automatically (2023.eacl-main)

Challenge:	Unsupervised text summarization methods are promising, but their performance is still behind that of state-of-the-art supervised methods.
Approach:	They propose a method based on Q-learning with an edit-based summarization that uses an Editorial Agent and Language Model converter to predict edit actions.
Outcome:	The proposed method delivers competitive performance even with zero paired data, while requiring no validation set.

Copied to clipboard

Sedrick Scott Keh, Steven Y. Feng, Varun Gangal, Malihe Alikhani, Eduard Hovy

Syntactic Text Processing

Challenge:	Phonetic difficulty is hard to characterize and can be expressed in tongue twisters through alliteration and homophony.
Approach:	They propose a phoneme-aware neural completion to generate tongue twisters automatically . they leverage phoneme representations to capture phonetic difficulty and train language models .
Outcome:	The proposed language model generates novel, phonetically difficult, fluent, and semantically meaningful tongue twisters on two task settings.

Great Memory, Shallow Reasoning: Limits of kNN-LMs (2025.naacl-short)

Copied to clipboard

Shangyi Geng, Wenting Zhao, Alexander M Rush

Reasoning

Challenge:	Existing models trained on poor quality data have shown strong performance in language modeling and some downstream benchmarks.
Approach:	They evaluate kNN-LMs on a diverse set of tasks and evaluate their performance.
Outcome:	The proposed extension could improve on a variety of tasks, but it fails to perform on reasoning tasks that require integrating multiple pieces of information.

Self-Repetition in Abstractive Neural Summarizers (2022.aacl-short)

Copied to clipboard

Nikita Salkar, Thomas Trikalinos, Byron Wallace, Ani Nenkova

A Game-Theoretica Negotiation Framework for Cross-Cultural Consensus (2026.acl-long)

Challenge:	a quantitative and qualitative analysis of self-repetition in neural summarization systems is needed to improve training.
Approach:	They propose a quantitative and qualitative analysis of self-repetition in neural summarization systems . they analyze the behavior of three popular architectures fine-tuned on five datasets .
Outcome:	The proposed model produces formulaic repetition in summaries, but not in summarization tasks.

Copied to clipboard

Guoxi Zhang, Jiawei Chen, Tianzhuo Yang, Jiaming Ji, Yaodong Yang, Juntao Dai

Neural data-to-text generation: A comparison between pipeline and end-to-end architectures (D19-1)

Challenge:	Large language models exhibit pronounced WEIRD cultural bias, marginalizing diverse viewpoints and posing challenges for reconciling diverse populations with varying cultural backgrounds and value systems.
Approach:	They propose a framework for cross-cultural fairness using a Nash Equilibrium . they propose equilibriums that iteratively propose and refine natural-language guidelines .
Outcome:	The proposed framework generates higher-quality and more balanced consensus . it finetunes diverse LLM architectures with negotiation data, reducing cultural distances by 95.53%.

Copied to clipboard

Thiago Castro Ferreira, Chris van der Lee, Emiel van Miltenburg, Emiel Krahmer

Text Generation

Challenge:	Traditionally, data-to-text applications have been designed using a modular pipeline architecture, in which the non-linguistic input data is converted into natural language through several intermediate transformations.
Approach:	They propose to use Gated-Recurrent Units and Transformer to implement neural pipelines for data-to-text generation.
Outcome:	The proposed models generalize better to unseen inputs and have better performance than the existing pipeline architectures.

Alignment Annotation for Clinic Visit Dialogue to Clinical Note Sentence Language Generation (2020.lrec-1)

Copied to clipboard

Wen-wai Yim, Meliha Yetisgen, Jenny Huang, Micah Grossman

Natural Language Interfaces

Challenge:	Despite advances in natural language processing, converting a clinic visit conversation into a clinical note is a largely unexplored area of research.
Approach:	They propose an annotation methodology that is content- and technique- agnostic while associating note sentences to sets of dialogue sentences.
Outcome:	The proposed method is content- and technique-agnostic while associating note sentences to sets of dialogue sentences.

Generalized Intent Discovery: Learning from Open World Dialogue System (2022.coling-1)

Copied to clipboard

Yutao Mou, Keqing He, Yanan Wu, Pei Wang, Jingang Wang, Wei Wu, Yi Huang, Junlan Feng, Weiran Xu

Learning Outside the Box: Discourse-level Features Improve Metaphor Identification (N19-1)

Challenge:	Existing intent classification models rely on a pre-defined intent set and supervised labels, which is limited in some practical scenarios.
Approach:	They propose to extend an IND intent classifier to an open-world intent set including IND and OOD intents.
Outcome:	The proposed task can classify IND and OOD intents while discovering new unlabeled OOD types incrementally.

Copied to clipboard

Jesse Mu, Helen Yannakoudakis, Ekaterina Shutova

Challenge:	Current approaches to metaphor identification use restricted linguistic contexts, e.g. by only considering a verb’s arguments or the sentence containing a phrase.
Approach:	They propose to train simple gradient boosting classifiers on representations of an utterance and its surrounding discourse learned with a variety of document embedding methods.
Outcome:	The proposed classifiers obtained state-of-the-art results on the 2018 VU Amsterdam metaphor identification task without complex metaphor-specific features or deep neural architectures employed by other systems.

Deconfounding Legal Judgment Prediction for European Court of Human Rights Cases Towards Better Alignment with Experts (2022.emnlp-main)

Copied to clipboard

T.y.s.s Santosh, Shanshan Xu, Oana Ichim, Matthias Grabmair

“Why do I feel offended?” - Korean Dataset for Offensive Language Identification (2023.findings-eacl)

Challenge:	Legal Judgement Prediction systems without expert-informed adjustments can be vulnerable to shallow, distracting surface signals.
Approach:	They propose to use domain expertise to identify statistically predictive but legally irrelevant information and adopt adversarial training to prevent it from relying on it.
Outcome:	The proposed model aligns better with expert rationales than baseline models . the results are compared with an existing benchmark dataset of human rights cases .

Copied to clipboard

San-Hee Park, Kang-Min Kim, O-Joun Lee, Youjin Kang, Jaewon Lee, Su-Min Lee, SangKeun Lee

Text Classification

Challenge:	Existing methods for detecting offensive content rely on labeled datasets, but few consider low-resource languages with relatively less data available for training.
Approach:	They propose to use Korean as a dataset for offensive language identification . they propose to perform abusive language detection and sentiment analysis to help identify offensive languages.
Outcome:	The proposed datasets improve the performance of offensive language identification in Korean, while the existing methods are limited.

Crowdsourcing Question-Answer Meaning Representations (N18-2)

Copied to clipboard

Julian Michael, Gabriel Stanovsky, Luheng He, Ido Dagan, Luke Zettlemoyer

Representation Learning

Challenge:	Existing datasets for predicate-argument relationships are lacking highly skilled and trained annotators.
Approach:	They propose a crowdsourcing scheme to generate question-answer pairs that represent predicate-argument relationships in sentences as a set of question-announcer pairs.
Outcome:	The proposed model covers the vast majority of predicate-argument relationships in existing datasets along with many previously under-resourced ones, including implicit arguments and relations.

CiteBART: Learning to Generate Citations for Local Citation Recommendation (2025.emnlp-main)

Copied to clipboard

Ege Yiğit Çelik, Selma Tekir

Effective Performance Measurement: Challenges and Opportunities in KPI Extraction from Earnings Calls (2026.acl-industry)

Challenge:	Local citation recommendation (LCR) suggests a set of papers for a citation placeholder in a given context.
Approach:	They introduce a citation-specific pre-training framework where author-date citation tokens are masked to learn to reconstruct them to fulfill local citation recommendation (LCR).
Outcome:	The proposed model achieves state-of-the-art performance on LCR benchmarks except for the FullTextPeerRead dataset, which is quite small to see the advantage of generative pre-training.

Copied to clipboard

Rasmus T. Aavang, Rasmus Tjalk-Bøggild, Alexandre Iolov, Giovanni Rizzi, Mike Zhang, Johannes Bjerva

Information Extraction & Text Mining

Challenge:	Earnings calls are a key source of financial information about public companies. extracting information from earnings calls is difficult.
Approach:	They propose to use LLMs to perform open-ended extraction from unstructured call transcripts to provide a baseline for this valuable domain through the consistent tracking of emergent KPIs.
Outcome:	The proposed method provides a baseline for this valuable domain through the consistent tracking of emergent KPIs.

AdaPT: A Set of Guidelines for Hyperbolic Multimodal Multilingual NLP (2024.findings-naacl)

Copied to clipboard

Ramit Sawhney, Shrey Pandit, Vishwa Shah, Megh Thakkar, Shafiq Joty

Neural Sequence Segmentation as Determining the Leftmost Segments (2021.naacl-main)

Challenge:	Euclidean space is used for training neural models and performing arithmetic operations, but many data types have complex geometries and cannot be captured in the Euclidesan space.
Approach:	They propose a set of guidelines for initialization, parametrization, and training of neural networks that can be generalized over existing neural network training methodologies.
Outcome:	The proposed framework outperforms Euclidean methods on three tasks over 12 languages and modalities on a variety of domains.

Copied to clipboard

Yangming Li, Lemao Liu, Kaisheng Yao

Syntactic Text Processing

Challenge:	Existing methods to segment sentences are mostly at token level, limiting their full potential to capture long-term dependencies.
Approach:	They propose a framework that incrementally segments natural language sentences at segment level.
Outcome:	The proposed framework outperforms baseline methods on syntactic chunking and Chinese part-of-speech tagging datasets.

Graph Neural Networks with Generated Parameters for Relation Extraction (P19-1)

Copied to clipboard

Hao Zhu, Yankai Lin, Zhiyuan Liu, Jie Fu, Tat-Seng Chua, Maosong Sun

Information Extraction & Text Mining

Challenge:	Existing graph neural networks can only process multi-hop relational reasoning on pre-defined graphs and cannot be directly applied in natural language relational reasoning.
Approach:	They propose a graph neural network with generated parameters using natural language sentences as inputs.
Outcome:	The proposed model can process relational reasoning on graphs and in natural language processing tasks.

Development and Benchmarking of a Blended Human-AI Qualitative Research Assistant (2026.acl-industry)

Copied to clipboard

Joseph Matveyenko, James Liu, John David Parsons, Ryan Brown, Alina I. Palimaru, Vipul Gupta, Prateek Puri

Challenge:	Qualitative research emphasizes constructing meaning through iterative engagement with textual data.
Approach:	They present and benchmark a qualitative research assistant system that allows researchers to identify themes and annotate datasets.
Outcome:	The proposed system achieves an inter-rater reliability between Muse and humans of Cohen’s = 0.7 for well-specified codes.

Training-free Neural Architecture Search for RNNs and Transformers (2023.acl-long)

Copied to clipboard

Aaron Serianni, Jugal Kalita

GeAR: Generation Augmented Retrieval (2025.findings-acl)

Challenge:	Neural architecture search (NAS) has allowed for the automatic creation of new and effective neural network architectures.
Approach:	They develop a new NAS metric that predicts the trained performance of an RNN architecture and significantly outperforms existing NAS metrics.
Outcome:	The proposed metric outperforms existing training-free metrics on the NAS-Bench-NLP benchmark.

Copied to clipboard

Haoyu Liu, Shaohan Huang, Jianfeng Liu, Yuefeng Zhan, Hao Sun, Weiwei Deng, Feng Sun, Furu Wei, Qi Zhang

Information Retrieval

Challenge:	Document retrieval techniques are used to compute semantic similarity between a query and documents, but the scalar similarity fails to reflect enough information, hindering the interpretation of retrieval results.
Approach:	They propose a method which improves the global document-query similarity through contrastive learning and integrates well-designed fusion and decoding modules.
Outcome:	The proposed method improves the global document-query similarity through contrastive learning and integrates well-designed fusion and decoding modules.

Mitigating the Inconsistency Between Word Saliency and Model Confidence with Pathological Contrastive Training (2022.findings-acl)

Copied to clipboard

Pengwei Zhan, Yang Wu, Shaolei Zhou, Yunjian Zhang, Liming Wang

Explainability & Interpretability in NLP

Challenge:	Neural networks are used for various NLP tasks, but their complexity makes them difficult to interpret.
Approach:	They propose a framework to mitigate the model pathology and obtain more interpretable models by using contrastive learning and saliency-based samples augmentation to calibrate the sentences representation.
Outcome:	The proposed framework can mitigate the model pathology and generate more interpretable models while keeping the model performance.

Generating Diverse Translations with Sentence Codes (P19-1)

Copied to clipboard

Raphael Shu, Hideki Nakayama, Kyunghyun Cho

Text Generation

Challenge:	Existing methods to generate diverse translations use different sentence structures . Xu et al., 2018: generating multiple valid translations with high diversity is difficult .
Approach:	They propose to use sentence codes to condition the sentence generation to obtain diverse translations . they propose to sample multiple candidates, each of which conditioned on a unique code .
Outcome:	The proposed method generates paraphrase translations with drastically different structures . the proposed method can be easily adopted to existing translation systems .

RAG-Critic: Leveraging Automated Critic-Guided Agentic Workflow for Retrieval Augmented Generation (2025.acl-long)

Copied to clipboard

Guanting Dong, Jiajie Jin, Xiaoxi Li, Yutao Zhu, Zhicheng Dou, Ji-Rong Wen

Information Retrieval

Challenge:	Recent advances in large language models (LLMs) have demonstrated remarkable performance across a wide range of downstream tasks.
Approach:	They propose a framework that leverages a critic-guided agentic workflow to improve RAG capabilities autonomously.
Outcome:	The proposed framework improves RAG capabilities autonomously by leveraging a critic-guided agentic workflow.

What About the Precedent: An Information-Theoretic Analysis of Common Law (2021.naacl-main)

Copied to clipboard

Josef Valvoda, Tiago Pimentel, Niklas Stoehr, Ryan Cotterell, Simone Teufel

Challenge:	In common law, the outcome of a new case is determined mostly by precedent cases, rather than by existing statutes.
Approach:	They propose to model the argumentation of precedent cases and compare them to a case out-come classification task to determine how the precedent influences the outcome of a new case.
Outcome:	The proposed method compared arguments of two longstanding jurisprudential views on the European Court of Human Rights (ECtHR) and the precedent cases.

Don’t be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue System (2021.emnlp-main)

Copied to clipboard

Libo Qin, Tianbao Xie, Shijue Huang, Qiguang Chen, Xiao Xu, Wanxiang Che

Natural Language Interfaces

Challenge:	Consistency Identification has been used for preventing inconsistent response generation, but few efforts have been made to task-oriented dialogue.
Approach:	They propose a dataset for Consistency Identification in task-oriented dialog system.
Outcome:	The proposed dataset is based on a single label and provides fine-grained labels to encourage model to know what inconsistent sources lead to it.

GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation (2021.findings-emnlp)

Copied to clipboard

Kang Min Yoo, Dongju Park, Jaewook Kang, Sang-Woo Lee, Woomyoung Park

Predicting Desirable Revisions of Evidence and Reasoning in Argumentative Writing (2023.findings-eacl)

Challenge:	Recent studies report that prompt-based direct classification eliminates the need for fine-tuning but lacks data and inference scalability.
Approach:	They propose a data augmentation technique that leverages large-scale language models to generate real text samples from a mixture of real samples.
Outcome:	The proposed method outperforms existing methods on diverse classification tasks.

Copied to clipboard

Tazin Afrin, Diane Litman

Reasoning

Challenge:	Using the essay context of the revision and feedback from students prior to the revision, we identify desirable and undesirable revisions.
Approach:	They propose to use the essay context of the revision and the feedback students received before the revision to improve classifier performance.
Outcome:	The proposed models improve over baseline models, while models utilizing context improve over the baseline models.

End-to-End Learnable Psychiatric Scale Guided Risky Post Screening for Depression Detection on Social Media (2025.emnlp-main)

Copied to clipboard

Bichen Wang, Yuzhe Zi, Yixin Sun, Hao Yang, Yanyan Zhao, Bing Qin

Challenge:	Existing methods to detect depression from social media posting history are limited by frozen screening models and lack of learning.
Approach:	They propose to use a frozen screening model to train a risky post detection model with psychiatric scales to enable a learnable end-to-end learning process.
Outcome:	The proposed model outperforms several strong baseline methods and qualitative analysis confirms that it better captures users’ mental states than others.

Long-form evaluation of model editing (2024.naacl-long)

Copied to clipboard

Domenic Rosati, Robie Gonzales, Jinkun Chen, Xuemin Yu, Yahya Kayani, Frank Rudzicz, Hassan Sajjad

Challenge:	Existing evaluations of model editing only use the ‘next few tokens’ completions after a prompt.
Approach:	They propose a new evaluation protocol that measures the efficacy and impact of model editing in long-form generative settings by using a machine-rated survey and a classifier which correlates well with human ratings.
Outcome:	The proposed evaluation protocol has little relationship with short-form metrics despite being designed to extend efficacy, generalization, locality, and portability into a long-form setting.

Investigating the Representation of Backchannels and Fillers in Fine-tuned Language Models (2026.acl-long)

Copied to clipboard

Yu Wang, Leyi Lao, Langchu Huang, Gabriel Skantze, Yang Xu, Hendrik Buschmeier

ZiNet: Linking Chinese Characters Spanning Three Thousand Years (2022.findings-acl)

Challenge:	Backchannels and fillers are important linguistic expressions in dialogue, but often ignored in modern transformer-based language models.
Approach:	They use clustering analysis to learn backchannels and fillers in dialogues in English and Japanese and use natural language generation metrics to confirm this.
Outcome:	The proposed models can learn representations of backchannels and fillers using three fine-tuning strategies.

Copied to clipboard

Yang Chi, Fausto Giunchiglia, Daqian Shi, Xiaolei Diao, Chuntao Li, Hao Xu

Knowledge Representation

Challenge:	tens of thousands of ancient characters must be deciphered by experts to interpret unearthed documents.
Approach:	They propose a diachronic Chinese knowledge base to help researchers discover glyph similar characters by measuring glyph similarities between ancient Chinese characters.
Outcome:	The proposed method shows strong correlations between the scores obtained from the method and from human experts.

Multimodal Dialogue State Tracking (2022.naacl-main)

Copied to clipboard

Hung Le, Nancy Chen, Steven Hoi

CANarEx: Contextually Aware Narrative Extraction for Semantically Rich Text-as-data Applications (2022.findings-emnlp)

Challenge:	Dialogue state tracking is a key component of dialogue systems.
Approach:	They propose to extend the definition of dialogue state tracking to multimodality . they propose a new synthetic benchmark and a novel baseline for this task .
Outcome:	The proposed task is based on a synthetic benchmark and a self-supervised video understanding task.

Copied to clipboard

Nandini Anantharama, Simon Angus, Lachlan O’Neill

Novel Slot Detection: A Benchmark for Discovering Unknown Slot Types in the Task-Oriented Dialogue System (2021.acl-long)

Challenge:	Narrative modelling is a field of active research that conceptualizes narratives as connected entity chains.
Approach:	They propose an alternative narrative extraction approach using semantic role labeling to extract tuples from text, then dimensionality reduction to reduce the space of entities and connections separately.
Outcome:	The proposed approach improves on a text-as-data task and improves accuracy and recall.

Copied to clipboard

Yanan Wu, Zhiyuan Zeng, Keqing He, Hong Xu, Yuanmeng Yan, Huixing Jiang, Weiran Xu

Natural Language Interfaces

Challenge:	Existing slot filling models can only recognize pre-defined in-domain slot types from a limited slot set.
Approach:	They introduce a task, Novel Slot Detection, in the task-oriented dialogue system.
Outcome:	The proposed task is based on two public NSD datasets and proposes strong baselines . it aims to identify a sequence of tokens and extract semantic constituents from user queries .

Negation, Coordination, and Quantifiers in Contextualized Language Models (2022.coling-1)

Copied to clipboard

Aikaterini-Lida Kalouli, Rita Sevastjanova, Christin Beck, Maribel Romero

A Discrete Hard EM Approach for Weakly Supervised Question Answering (D19-1)

Challenge:	Recent work has focused on specific tasks and on the learning outcome.
Approach:	They propose to decouple the weaknesses from specific tasks and focus on the embeddings per se and their mode of learning.
Outcome:	The proposed model can learn semantic constraints and how the context impacts their embeddings.

Copied to clipboard

Sewon Min, Danqi Chen, Hannaneh Hajishirzi, Luke Zettlemoyer

FACTOID: A New Dataset for Identifying Misinformation Spreaders and Political Bias (2022.lrec-1)

Challenge:	Existing work on question answering tasks only provide weak supervision for how the answer should be computed . weak supervision is attractive because it is relatively easy to gather, allowing for large datasets . but weak supervision complicates learning because there are many different spurious ways to derive the correct answer.
Approach:	They propose a method to convert question answering tasks into discrete latent variable learning problems with a precomputed set of possible solutions that contains one correct option.
Outcome:	The proposed approach outperforms previous methods on six QA tasks and achieves state-of-the-art on five of them.

Copied to clipboard

Flora Sakketou, Joan Plepi, Riccardo Cervero, Henri Jacques Geiss, Paolo Rosso, Lucie Flek

Ethical NLP

Challenge:	Proactively identifying misinformation spreaders is an important step towards mitigating the impact of fake news on our society.
Approach:	They propose a new reddit dataset for fake news spreader analysis, called FACTOID, which tracks political discussions on Reddit since the beginning of 2020.
Outcome:	The proposed dataset contains over 4K users with 3.4M posts and includes their credibility level (very low to very high) and political bias strength (extreme right to extreme left).

CookingSense: A Culinary Knowledgebase with Multidisciplinary Assertions (2024.lrec-main)

Copied to clipboard

Donghee Choi, Mogan Gim, Donghyeon Park, Mujeen Sung, Hyunjae Kim, Jaewoo Kang, Jihun Choi

Domain-Oriented Prefix-Tuning: Towards Efficient and Generalizable Fine-tuning for Zero-Shot Dialogue Summarization (2022.naacl-main)

Challenge:	CookingSense is a descriptive collection of knowledge assertions in the culinary domain extracted from various sources, including web data, scientific papers, and recipes.
Approach:	They introduce CookingSense, a descriptive collection of knowledge assertions in the culinary domain extracted from various sources, including web data, scientific papers, and recipes.
Outcome:	The proposed system improves retrieval augmented language models and food decision support systems.

Copied to clipboard

Lulu Zhao, Fujia Zheng, Weihao Zeng, Keqing He, Weiran Xu, Huixing Jiang, Wei Wu, Yanan Wu

How Knowledge Graph and Attention Help? A Qualitative Analysis into Bag-level Relation Extraction (2021.acl-long)

Challenge:	Existing methods for domain adaptation of abstractive dialogue summarization lack generalization ability on new domains.
Approach:	They propose a domain-oriented prefix-tuning model that uses a prefix module to alleviate domain entanglement and discrete prompts to guide the model to focus on key contents of dialogues.
Outcome:	The proposed model can be generalized to two multi-domain dialogue summarization datasets.

Copied to clipboard

Zikun Hu, Yixin Cao, Lifu Huang, Tat-Seng Chua

Knowledge Representation

Challenge:	Knowledge Graph (KG) and attention mechanism have been demonstrated effective in introducing and selecting useful information for weakly supervised methods.
Approach:	They propose a paradigm to quantitatively evaluate the effect of attention and KG on bag-level relation extraction (RE) they propose to incorporate entity prior to KG-enhanced attention to improve RE performance .
Outcome:	The proposed model achieves significant improvements on two real-world datasets compared with three state-of-the-art baselines.

MultiMWE: Building a Multi-lingual Multi-Word Expression (MWE) Parallel Corpora (2020.lrec-1)

Copied to clipboard

Lifeng Han, Gareth Jones, Alan Smeaton

Multilinguality

Challenge:	Existing bilingual or multi-lingual MWE corpora are limited for multilingual use . only 871 pairs of English-German MWEs are available for research .
Approach:	They present a collection of bilingual and multi-lingual MWEs extracted from parallel corpora.
Outcome:	The available bilingual or multi-lingual MWE corpus is very limited . the collection is a small collection of 871 pairs of English-German MWEs .

Explaining Character-Aware Neural Networks for Word-Level Prediction: Do They Discover Linguistic Rules? (D18-1)

Copied to clipboard

Fréderic Godin, Kris Demuynck, Joni Dambre, Wesley De Neve, Thomas Demeester

Syntactic Text Processing

Challenge:	Character-level features are used in many natural language processing algorithms but little is known about the character-level patterns they learn.
Approach:	They extend contextual decomposition technique to convolutional neural networks and bidirectional long-term memory networks to evaluate and compare these models for morphological tagging on three morphology-dependent languages.
Outcome:	The proposed models implicitly discover understandable linguistic rules for morphological tagging on three morphology-dependent languages.

Analysing Lexical Semantic Change with Contextualised Word Representations (2020.acl-main)

Copied to clipboard

Mario Giulianelli, Marco Del Tredici, Raquel Fernández

Modeling Human Mental States with an Entity-based Narrative Graph (2021.naacl-main)

Challenge:	Existing studies on lexical semantic change have focused on detecting and characterising word meaning shifts using distributional semantic models.
Approach:	They propose a method that exploits the BERT neural language model to obtain representations of word usages, clusters these representations into usage types, and measures change along time with three proposed metrics.
Outcome:	The proposed method captures a variety of synchronic and diachronic linguistic phenomena and is highly reproducible and reproducible.

Copied to clipboard

I-Ta Lee, Maria Leonor Pacheco, Dan Goldwasser

VisText: A Benchmark for Semantically Rich Chart Captioning (2023.acl-long)

Challenge:	Understanding narrative text requires capturing characters’ motivations, goals, and mental states.
Approach:	They propose an Entity-based Narrative Graph (ENG) to model the internal-states of characters in a story and evaluate it on two narrative understanding tasks.
Outcome:	The proposed model is based on two narrative understanding tasks: predicting character mental states, and desire fulfillment.

Copied to clipboard

Benny Tang, Angie Boggust, Arvind Satyanarayan

Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation (2021.naacl-main)

Challenge:	Current approaches for automatically generating chart captions struggle to articulate the perceptual or cognitive features that are the hallmark of charts (e.g., complex trends and patterns).
Approach:	They propose a dataset of 12,441 pairs of charts and captions that describe charts’ construction, report key statistics, and identify perceptual and cognitive phenomena.
Outcome:	The proposed model generates coherent, semantically rich captions and performs on par with state-of-the-art chart captioning models across machine translation and text generation metrics.

Copied to clipboard

Yasuhide Miura, Yuhao Zhang, Emily Tsai, Curtis Langlotz, Dan Jurafsky

Small Language Models can Outperform Humans in Short Creative Writing: A Study Comparing SLMs with Humans and LLMs (2025.coling-main)

Challenge:	Existing report generation systems suffer from incomplete and inconsistent generation, despite achieving high performance on natural language metrics such as CIDEr and BLEU.
Approach:	They propose two new rewards that encourage the generation of factually complete and consistent radiology reports by using an existing semantic equivalence metric.
Outcome:	The proposed system significantly improves the F1 score of a clinical information extraction performance on two open radiology report datasets.

Copied to clipboard

Guillermo Marco, Luz Rello, Julio Gonzalo

Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering (2021.acl-long)

Challenge:	a fine-tuned small language model (SLM) can generate human-like text, but it requires immense computational resources and large datasets.
Approach:	They evaluate the creative writing abilities of a fine-tuned small language model, BART-large . they compare it to human writers and two large language models: GPT-3.5 and GPT-4o .
Outcome:	The proposed model outperforms human writers and two large language models in two experiments . the results highlight how model size and fine-tuning influence creativity, fluency, and coherence .

Copied to clipboard

Ahjeong Seo, Gi-Cheon Kang, Joonhan Park, Byoung-Tak Zhang

Pengwei Zhan, Jing Yang, He Wang, Chao Zheng, Xiao Huang, Liming Wang

Challenge:	Recent advances in natural language processing and computer vision have made significant progress in artificial intelligence (AI).
Approach:	They propose Motion-Appearance Synergistic Networks which embed cross-modal features grounded on motion and appearance information and selectively utilize them depending on the question’s intentions.
Outcome:	The proposed network achieves state-of-the-art on the TGIF-QA and MSVD-QA datasets and qualitatively analyzes the results.

Copied to clipboard

PINEAPPLE: Personifying INanimate Entities by Acquiring Parallel Personification Data for Learning Enhanced Generation (2022.coling-1)

Challenge:	Neural language models are vulnerable to word-level adversarial text attacks . previous word-based search methods assume important words influence prediction .
Approach:	They propose a method for similarizing the influence of words with contrast learning that encourages model to learn sentence representations in which words of varying importance have a more uniform influence on prediction.
Outcome:	The proposed method is compatible with various training methods and improves model robustness against various adversarial attacks.

Copied to clipboard

Sedrick Scott Keh, Kevin Lu, Varun Gangal, Steven Y. Feng, Harsh Jhamtani, Malihe Alikhani, Eduard Hovy

Challenge:	Personifications are figures of speech that endow inanimate entities with properties and actions typically seen as requiring animacy.
Approach:	They propose to use personification data to train a parallel corpus of personifications . they propose to combine personification-related literalizations with automatic ones .
Outcome:	The proposed personification system can generate diverse and creative personifications . it can generate personification-related qualities such as interestingness and animacy .

Reasoning Gets Harder for LLMs Inside A Dialogue (2026.acl-long)

Copied to clipboard

Ivan Kartáč, Mateusz Lango, Ondrej Dusek

Measuring What Matters: Evaluating Ensemble LLMs with Label Refinement in Inductive Coding (2025.findings-acl)

Challenge:	Large Language Models (LLMs) achieve strong performance on many reasoning benchmarks, yet these evaluations typically focus on isolated tasks that differ from real-world usage in task-oriented dialogue (TOD).
Approach:	They propose to use a dynamic benchmark to examine how framing reasoning tasks within task-oriented dialogue (TOD) affect LLM performance.
Outcome:	The proposed model performs well on isolated tasks and in task-oriented dialogues, but performance is inconsistent between them.

Copied to clipboard

Angelina Parfenova, Jürgen Pfeffer

SummScreen: A Dataset for Abstractive Screenplay Summarization (2022.acl-long)

Challenge:	Large language models (LLMs) are prone to inconsistencies and individual biases, limiting their reliability.
Approach:	They propose a framework that combines ensemble methods with code refinement methodology to address these challenges.
Outcome:	The proposed framework outperforms large language models and LLMs with a low-rank averaging and a moderator-based mechanism to simulate human consensus.

Copied to clipboard

Mingda Chen, Zewei Chu, Sam Wiseman, Kevin Gimpel

Information Extraction & Text Mining

Challenge:	Existing summarization datasets are constructed from various domains, such as news, and we characterize them using two entity-centric metrics.
Approach:	They propose to use a summarization dataset to evaluate TV series transcripts and recaps . they propose to employ two entity-centric metrics to evaluate the dataset .
Outcome:	The proposed model outperforms the existing model and its oracle counterparts in character overlap and accuracy.

Learning to Decode Collaboratively with Multiple Language Models (2024.acl-long)

Copied to clipboard

Zejiang Shen, Hunter Lang, Bailin Wang, Yoon Kim, David Sontag

CentaurTA: A Self-Improving Human-Agents Collaboration Framework for Thematic Analysis (2026.findings-acl)

Challenge:	Using a latent variable model, multiple large language models can be trained to collaborate at the token level.
Approach:	They propose a method to teach multiple large language models to collaborate by interleaving their generations at the token level.
Outcome:	The proposed method improves on instruction-following, domain-specific QA, and reasoning tasks and shows that the model trained with the method exhibits several interesting collaboration patterns.

Copied to clipboard

Lei Wang, Min Huang, Eduard Dragut

Challenge:	Existing large language model approaches for qualitative analysis are labor-intensive and costly.
Approach:	They propose an iterative human–agent framework for scalable thematic analysis that integrates structured human feedback with rubric-based evaluation.
Outcome:	The proposed framework improves coding alignment and transparency across multiple datasets, baselines, and LLM families.

RaDA: Retrieval-augmented Web Agent Planning with LLMs (2024.findings-acl)

Copied to clipboard

Minsoo Kim, Victor Bursztyn, Eunyee Koh, Shunan Guo, Seung-won Hwang

From Words to Wires: Generating Functioning Electronic Devices from Natural Language Descriptions (2023.findings-emnlp)

Challenge:	Agents powered by large language models inherit important limitations such as the restricted context length, dependency on human-engineered exemplars, and insufficient generalization.
Approach:	They propose a novel planning method for Web agents that disentangles planning into two stages: for a new given task, it decomposes tasks into high-level subtasks; and then iteratively synthesizes actions based on dynamically retrieved exemplars.
Outcome:	The proposed method decomposes tasks into high-level subtasks and iteratively synthesizes actions based on dynamically retrieved exemplars.

Copied to clipboard

Peter Jansen

No perspective, no perception!! Perspective-aware Healthcare Answer Summarization (2024.findings-acl)

Challenge:	Recent work shows that language models have a capacity for electronic circuit design from high-level textual descriptions, akin to code generation.
Approach:	They propose two benchmarks to assess a model's ability to design common microcontroller circuits and code in the Arduino ecosystem.
Outcome:	The proposed model knowledge of electrical components and the model's ability to generate full circuits and code in the Arduino ecosystem are evaluated.

Copied to clipboard

Gauri Naik, Sharad Chandakacherla, Shweta Yadav, Md Shad Akhtar

Summarization

Challenge:	Healthcare Community Question Answering forums are prone to off-topic discussions and diverse answers can be challenging for readers to sift through.
Approach:	They propose a task of perspective-specific answer summarization to identify different perspectives within healthcare-related responses and frame a perspective-driven abstractive summary covering all responses.
Outcome:	The proposed model outperforms existing models against five baselines and shows that it is more accurate than existing models.

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct (2025.findings-acl)

Copied to clipboard

Run Luo, Haonan Zhang, Longze Chen, Ting-En Lin, Xiong Liu, Yuchuan Wu, Min Yang, Yongbin Li, Minzheng Wang, Pengpeng Zeng, Lianli Gao, Heng Tao Shen, Yunshui Li, Hamid Alinejad-Rokny, Xiaobo Xia, Jingkuan Song, Fei Huang

The Challenges of Creating a Parallel Multilingual Hate Speech Corpus: An Exploration (2024.lrec-main)

Challenge:	a new framework for image-text instruction data evolution improves MLLM performance . lack of high-quality instruction data remains a major bottleneck in ML modeling .
Approach:	They propose a multimodal instruction data evolution framework that iteratively enhances data quality through fine-grained perception, cognitive reasoning, and interaction evolution.
Outcome:	The proposed approach improves MLLM performance in nine vision-language tasks while using significantly less data.

Copied to clipboard

Katerina Korre, Arianna Muti, Alberto Barrón-Cedeño

Multilinguality

Challenge:	Hate speech is one of the most demanding topics in Natural Language Processing, as its multifaceted nature is accompanied by a handful of challenges, such as multilinguality and cross-linguality.
Approach:	They propose a pipeline that could be used to create a parallel multilingual hate speech dataset using machine translation.
Outcome:	The proposed pipeline will be able to create a parallel multilingual hate speech dataset using machine translation.

Improving Neutral Point-of-View Generation with Data- and Parameter-Efficient RL (2025.emnlp-main)

Copied to clipboard

Jessica Hoffmann, Christiane Ahlheim, Zac Yu, Aria Walfrand, Jarvis Jin, Marie Tano, Ahmad Beirami, Erin MacMurray van Liemt, Nithum Thain, Hakim Sidahmed, Lucas Dixon

Green & Sustainable NLP

Challenge:	Parameter-efficient reinforcement learning (PE-RL) is a highly effective training regime to improve large language models’ ability to answer queries on sensitive topics with a Neutral Point of View (NPOV).
Approach:	They propose to use parameter-efficient reinforcement learning to train large language models to answer queries with a Neutral Point of View (NPOV) This is compared to the strongest baseline, LoRA finetuning, SFT and RLHF.
Outcome:	The proposed training regime improves on NPOV quality and scores higher on features identified by linguists as key to separating good answers from the best answers.

EducationQ: Evaluating LLMs’ Teaching Capabilities Through Multi-Agent Dialogue Framework (2025.acl-long)

Copied to clipboard

Yao Shi, Rongkeng Liang, Yong Xu